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AMENDMENTS TO THE CLAIMS 

The listing of claims will replace all prior versions, and listings, of claims in the 
application. Claims 1-13 are herein amended and claims 14-20 are added. 

Listing of Claims 

1. (Currently Amended): In a processor having multiple hardware streams supporting 

multiple data threads, and a data cache, a system for fetching instructions from 
individual ones a selected one of the multiple hardware streams to a pipeline, the 
system comprising: 

multiple hit/miss predictors, each associated with a coiTesponding one of the 
multiple hardware streams, said each configured to forecast whether 
corresponding instructions from said correspondinR one of the multiple 
hardware streams will hit or miss the data cache; and 

a fetch algorithm , coupled to said multiple hit/miss predictors, configured to 

select, on a cvcle-bv-cycle basis, the selected one of the multiple hardware 
streams for sel e cting from which str e am to fetch the instructions.T-and 

a hit/miss pr e dictor for for e casting wheth e r instructions will hit or mis s th e data 
cache; 

wh e rein th e pr e diction by th e hit/miss predictor is used by th e f e tch algorithm in 
detennining from which stream to fetch. 

2. (Currently Amended): The system as recited in of claim 1 claim 1 , wherein a hit 

prediction precipitates no change in the fetching of the instmctionsp reee^s. 

3. (Currently Amended): The syste m as recited in of claim 1 claim 1, wherein a miss 

prediction results in switching the fetching f e tching to a different one of the 
multiple hardware s^eam streams . 
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4. (Currently Amended): The system of claim l as recited in claim L wherein the hit/miss 

pr e dictor said each of said multiple hit/miss predictors det e nnines a hit 
probabilitv generates a confidence level value , and the probability is said 
confidence level value is used by th e f e tch said fetch algorithm in d e t e rmining 
irom wh e r e to f e tch n e xt iuGtmctions to select the selected one of the multiple 
hardware streams . 

5. (Currently Amended): The system of claim 1 as recited in claim L wherein the forecast 

of th e hit/misG predictor is also used by a dispatch algorithm in s e l e cting 
instructions from the pipeline to dispatch to functional units said multiple hit/miss 
predictors operate at a dispatch level to optimize the dispatch of consumer 
instructions by predicting latency of data . 

6. (Currently Amended): A processor having multiple hardware steams supporting 

multiple data threads, the processor comprising: 

a data cache , comprising a plurality of levels ; 

multiple hit/miss predictors, each associated with a corresponding one of the 
multiple hardware streams, said each configured to forecast whether 
corresponding instructions fi"om said corresponding one of the multiple 
hardware streams will hit or miss said data cache, said each of said 
multiple hit/miss predictors comprising: 

a plurality of hit/miss predictors, each configured to forecast whether said 
corresponding instmctions from said corresponding one of the 
muUiple hardware streams will hit or miss one or more of said 
levels; and 
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a fetch algorithm, coupled to said multiple hit/miss predictors, configured to 

select, on a cvcle-bv-cvcle basis, the selected one of the multiple hardware 
streams from which to fetch the instructions, wherein said fetch algorithin 
selects the selected one of the multiple hardware streams based upon 
whether said corresponding instructions fi'om said corresponding one of 
the multiple hardware streams will hit or miss said one or more of said 
levels. 

^a fetch algorithm for selecting from which str e am to f e tch instructions; and 

a hit/mis s predictor for pr e dicting wh e th e r instructions will hit or miss th e cach e ; 

wh e r e in a pr e diction by the hit/miss predictor is used by th e f e tcli algorithm in 
determining from which stream to fetch. 

7. (Currently Amended): The processor of claim 6 as recited in claim 6. wherein a hit 

prediction precipitates no change in the fetching process of the instructions . 

8. (Currently Amended): The processor as recited in claim 6, of claim 6 wherein a miss 

prediction results in switching the fetching to a different one of the multiple 
hardware streams f e tching to a diff e r e nt stream . 

9. (Currently Amended): The processor of claim 6 as recited in claim 6. wherein said each 

of said multiple hit/miss predictors generates a confidence level value, and said 
confidence level value is used by said fetch algorithm to select the selected one of 
the multiple hardware streams. the hit/miss pr e dictor determines a hit probability, 
and th e probability i s used by the fetch algorithm in detemnning from where to 
fetch n e xt instmctions. 

10. (Currently Amended): The processor of claim 6 as recited in claim 6. wherein said 

multiple hit/miss predictors operate at a dispatch level to optimize the dispatch of 
consumer instructions by predicting latency of data. th e forecast of the hit/miss 
predictor is also us e d by a dispatch algorithm in selecting instructions from the 
pip e lin e to dispatch to functional units. 
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11. (Currently Amended): In a processor having multiple hardware streams supporting 

multiple data thr e ad, data threads, and a data cache, a method for fetching 
instructions from individual ones a selected one of the multiple hardware streams 
of multiple streams as instruction sources _to a pipeline, the method comprising: 
th e step s of: 

(aV for each of the multiple haidware streams, making a hit/miss prediction by a 
predictor a con^esponding one of associated hit/miss predictors as to 
whether corresponding instructions for the each of the multiple hardware 
stream p reviously fetched will hit or miss the data cache; and 

(b) if th e prediction is a miss, selecting, on a cvcle-by-cvcle basis, the selected one 
of the multiple hardware streams from which to fetch the instructions. 
alt e ring th e source of th e f e tch. 

12. (Currently Amended): The method of claim 1 1 as recited in claim 1 L wherein the 

hit/miss predictor det e miin e s a hit probability, and th e probability is us e d in 
det e rmininjj fetch source said making comprises: 

ReneratinR a confidence level value, and employing the confidence level to select 
the selected one of the multiple hardware streams . 

13. (Currently Amended): The method of claim 1 l as recited in claim 1 1 , wher e in th e 

forecast of th e hit/miss predictor is also us e d by a dispatch algorithm in selecting 
instructions to dispatch to functional units further comprising: 

operating the multiple hit/miss predictors at a dispatch level to optimize the 
dispatch of consumer instructions by predicting latency of data . 

14. (New): The system as recited in claim 1, wherein the processor comprises a fine- 

grained multistreaming processor that concmrently executes the instructions from 
the multiple hardware streams. 

15. (New): The system as recited in claim 1, wherein the data cache comprises: 

a first level and a second level, and wherein said each of said multiple hit/miss 
predictors comprises: 
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a first hit/miss predictor, configured to forecast whether said 

corresponding instructions fi'om said corresponding one of the 
multiple hardware streams will hit or miss said first level; and 

a second hit/miss predictor, configxired to forecast whether said 

corresponding instructions from said corresponding one of the 
multiple hardware streams will hit or miss said second level; 

wherein said fetch algorithm selects the selected one of the multiple hardware 
streams based upon whether said corresponding instructions fi'om said 
corresponding one of the multiple hardware streams will hit or miss said 
second level. 

16. (New): The system as recited in claim 1, wherein the processor comprises a network 

processor, and wherein said each of said multiple hit/miss predictors employs a 
flow number to which a packet belongs to forecast whether said corresponding 
instructions fi"om said corresponding one of the multiple hardware streams will hit 
or miss the data cache. 

17. (New): The processor as recited in claim 6, wherein the processor comprises a 

network processor, and wherein said each of said multiple hit/miss predictors 
employs a flow number to which a packet belongs to forecast whether said 
corresponding instructions fi-om said corresponding one of the multiple hardware 
streams will hit or miss the data cache. 

18. (New): The method as recited in claim 11, wherein said selecting comprises: 

switching the fetching to a different one of the multiple hardware streams. 

19. (New): The method as recited in claim 11, wherein the data cache comprises a first 

level and a second level, and wherein said making comprises: 

first forecasting whether said corresponding instructions from the corresponding 
one of the multiple hardware streams will hit or miss the first level; and 

second forecasting whether the corresponding instructions from the corresponding 
one of the multiple hardware streams will hit or miss the second level; and 
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wherein said selecting comprises: 

choosing the selected one of the multiple hardware streams based upon 

whether the corresponding instructions from the corresponding one 
of the multiple hardware streams will hit or miss the second level, 

20. (New): The method as recited in claim 11, wherein said making comprises: 

employing a flow number to which a packet belongs to forecast whether the 
corresponding instructions from the corresponding one of the multiple 
hardware streams will hit or miss the data cache. 
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